Electronic apparatus and control method thereof

ABSTRACT

An electronic apparatus for illuminating and photographing a user&#39;s face and a control method thereof are provided. The electronic apparatus includes a camera configured to photograph a user&#39;s face, a transceiver configured to perform communication with a user terminal, and at least one processor configured to photograph the user&#39;s face a plurality of times on the basis of a plurality of photographing parameters to obtain a plurality of images, extract face regions corresponding to each of the plurality of images photographed on the basis of the plurality of photographing parameters, synthesize the extracted user&#39;s face regions with each other to create a synthesized image, and control the transceiver to transmit data on the synthesized image to the user terminal for the purpose of skin analysis for the user&#39;s face.

CROSS-REFERENCE TO RELATED APPLICATION(S)

This application claims the benefit under 35 U.S.C. § 119(e) of a U.S.Provisional application filed on Nov. 14, 2016 in the U.S. Patent andTrademark Office and assigned Ser. No. 62/421,637, and under 35 U.S.C. §119(a) of a Korean patent application filed on Jan. 2, 2017 in theKorean Intellectual Property Office and assigned Serial number10-2017-0000180, the disclosure of which is hereby incorporated byreference.

TECHNICAL FIELD

The present disclosure relates to an electronic apparatus and a controlmethod thereof. More particularly, the present disclosure relates to anelectronic apparatus obtaining an image for analyzing the skin of auser's face by photographing the user's face a plurality of times, and acontrol method thereof.

BACKGROUND

Recently, in accordance with an increase in interest in beauty, aninterest in skin care of a user's face has increased. Particularly, anelectronic apparatus for photographing the skin of the user's face toanalyze various skin troubles (for example, a wrinkle, a pore, a pimple,and the like) existing on the user's face has been developed.

Such an electronic apparatus for analyzing skin according to the relatedart photographs the user's face on the basis of predeterminedphotographing parameters (for example, an intensity of a light source, adirection of the light source, an F No, a shutter speed, and the like)in a state in which the user's face is put into the electronic apparatusto shield external illumination. That is, the electronic apparatus foranalyzing skin according to the related art typically photographs theuser's face in a state in which external illumination is blocked andillumination is uniformly spread over the entirety of the user's facethrough light reflection in the electronic apparatus.

However, if an intensity of a light source is weak when the user's faceis photographed, it is difficult to distinguish between a dark portionand pigmentation at the time of analyzing an image. If an intensity ofthe light source is strong when the user's face is photographed, thereis a problem in that image information on a specific region can be lost.In addition, the electronic apparatus for analyzing skin according tothe related art has a form in which it surrounds the entirety of theuser's face and therefore, has a large size, and it is thus inconvenientto carry the electronic apparatus for analyzing skin according to therelated art.

The above information is presented as background information only, toassist with an understanding of the present disclosure. No determinationhas been made, and no assertion is made, as to whether any of the abovemight be applicable as prior art with regard to the present disclosure.

SUMMARY

Aspects of the present disclosure are to address at least theabovementioned problems and/or disadvantages, and to provide at leastthe advantages described below. Accordingly, an aspect of the presentdisclosure is to provide an electronic apparatus and method forobtaining a plurality of images by photographing a user's skin aplurality of times on the basis of a plurality of photographingparameters and synthesizing the plurality of images with each other tobe one face image for analyzing the skin.

In accordance with an aspect of the present disclosure, an electronicapparatus is provided. The electronic apparatus includes a cameraconfigured to photograph a user's face, a transceiver configured toperform communication with a user terminal, and at least one processorconfigured to control the camera to photograph the user's face aplurality of times on the basis of a plurality of photographingparameters to obtain a plurality of images, extract face regionscorresponding to each of the plurality of images photographed on thebasis of the plurality of photographing parameters, synthesize theextracted face regions with each other to create a synthesized image,and control the transceiver to transmit data on the synthesized image tothe user terminal for the purpose of skin analysis for the user's face.

In accordance with another aspect of the present disclosure, a controlmethod of an electronic apparatus is provided. The control methodincludes photographing a user's face a plurality of times on the basisof a plurality of photographing parameters to obtain a plurality ofimages, extracting face regions corresponding to each of the pluralityof images photographed on the basis of the plurality of photographingparameters and synthesizing the extracted face regions with each otherto create a synthesized image, and transmitting data on the synthesizedimage to a user terminal for the purpose of skin analysis for the user'sface.

In accordance with another aspect of the present disclosure anon-transitory computer-readable recording medium in which a program forexecuting a control method of an electronic apparatus is stored isprovided. The control method includes photographing a user's face aplurality of times on the basis of a plurality of photographingparameters to obtain a plurality of images, extracting face regionscorresponding to each of the plurality of images photographed on thebasis of the plurality of photographing parameters and synthesizing theextracted face regions with each other to create a synthesized image,and analyzing the synthesized image to decide a skin state of the user'sface, and providing information on the skin state.

As described above, according to the various embodiments of the presentdisclosure, a face image having a uniform brightness distribution overan entire region of a user's face may be obtained to increase accuracyof a face skin analyzing result. In addition, since the user's face doesnot need to be inserted into the electronic apparatus, the electronicapparatus may be manufactured having a small size and a light weight,such that convenience in carrying the electronic apparatus may beimproved.

Other aspects, advantages, and salient features of the disclosure willbecome apparent to those skilled in the art from the following detaileddescription, which, taken in conjunction with the annexed drawings,discloses various embodiments of the present disclosure.

BRIEF DESCRIPTION OF THE DRAWINGS

The above and other aspects, features, and advantages of certainembodiments of the present disclosure will be more apparent from thefollowing description taken in conjunction with the accompanyingdrawings, in which:

FIG. 1 is a view for describing a system for analyzing a user's skinaccording to an embodiment of the present disclosure;

FIG. 2 is a block diagram schematically illustrating components of anelectronic apparatus according to an embodiment of the presentdisclosure;

FIG. 3 is a block diagram illustrating components of an electronicapparatus according to an embodiment of the present disclosure indetail;

FIGS. 4A and 4B are views for describing examples of analyzing a user'sskin using a skin analyzing application according to an embodiment ofthe present disclosure;

FIGS. 5A, 5B and 5C are views for describing examples of analyzing auser's skin using a skin analyzing application according to anembodiment of the present disclosure;

FIGS. 6A, 6B, 6C, 6D and 6E are views for describing examples ofanalyzing a user's skin using a skin analyzing application according toan embodiment of the present disclosure;

FIG. 7 is a sequence diagram for describing a control method of a systemfor analyzing the skin of a user's face according to an embodiment ofthe present disclosure; and

FIGS. 8 and 9 are flowcharts for describing control methods of anelectronic apparatus according to an embodiment of the presentdisclosure.

Throughout the drawings, it should be noted that like reference numbersare used to depict the same or similar elements, features, andstructures.

DETAILED DESCRIPTION

The following description with reference to the accompanying drawings isprovided to assist in a comprehensive understanding of variousembodiments as defined by the claims and their equivalents. It includesvarious specific details to assist in that understanding, but these areto be regarded as merely exemplary. Accordingly, those of ordinary skillin the art will recognize that various changes and modifications of thevarious embodiments described herein can be made without departing fromthe scope and spirit of the present disclosure. In addition,descriptions of well-known functions and constructions may be omittedfor clarity and conciseness.

The terms and words used in the following description and claims are notlimited to the bibliographical meanings, but are merely used to enable aclear and consistent understanding of the present disclosure.Accordingly, it should be apparent to those skilled in the art that thefollowing description of various embodiments of the present disclosureis provided for illustration purpose only, and not for the purpose oflimiting the present disclosure as defined by the appended claims andtheir equivalents.

It is to be understood that the singular forms “a,” “an,” and “the”include plural referents unless the context clearly dictates otherwise.Thus, for example, reference to “a component surface” includes referenceto one or more of such surfaces.

Terms ‘first’, ‘second’, and the like, may be used to describe variouscomponents, but the components are not to be construed as being limitedby the terms. The terms are used only to distinguish one component fromanother component.

Singular forms are intended to include plural forms unless the contextclearly indicates otherwise. It will be further understood that terms“include” or “formed of” used in the present specification specify thepresence of features, numerals, steps, operations, components, parts, orcombinations thereof mentioned in the present specification, but do notpreclude the presence or addition of one or more other features,numerals, steps, operations, components, parts, or combinations thereof.

In various embodiments of the present disclosure, a ‘module’ or an‘˜er/˜or’ may perform at least one function or operation, and beimplemented by hardware or software or be implemented by a combinationof hardware and software. In addition, a plurality of ‘modules’ or aplurality of ‘˜ers/˜ors’ may be integrated in at least one module and beimplemented by at least one processor (not illustrated) except for a‘module’ or an ‘˜er/or’ that needs to be implemented by specifichardware.

In various embodiments of the present disclosure, a case in which anyportion is referred to as being “connected to” another portion not onlyincludes a case in which any one portion and another portion are“directly connected to” each other, but also a case in which any oneportion and another portion are “electrically connected to” each otherwith the other portion interposed therebetween. In addition, it not onlyincludes a case in which any one portion and another portion arephysically connected to each other, but also a case in which any oneportion and another portion are wirelessly connected to each other.Unless explicitly described to the contrary, “including” any componentwill be understood to imply the inclusion of other components ratherthan the exclusion of other components.

Hereinafter, various embodiments of the present disclosure will bedescribed in detail with reference to the accompanying drawings so thatthose skilled in the art to which the present disclosure pertains mayeasily practice the present disclosure. However, the present disclosuremay be implemented in various different forms and is not limited tovarious embodiments described herein. In addition, in the drawings,portions unrelated to the description may be omitted to describe thepresent disclosure, and similar portions will be denoted by similarreference numerals throughout the specification.

Hereinafter, the present disclosure will be described in detail withreference to the drawings.

FIG. 1 is a view for describing a system for analyzing a user's skinaccording to an embodiment of the present disclosure.

Referring to FIG. 1, a system may include an electronic apparatus 100and a user terminal 200. Here, the electronic apparatus 100 may be adedicated apparatus for photographing the user's skin. However, this isonly an example, and the electronic apparatus 100 may be implemented byanother electronic apparatus (for example, a smartphone, or the like)including a camera and a light source. The user terminal 200 may beimplemented by a smartphone. However, this is only an example, and theuser terminal 200 may be implemented by various terminals such as atablet personal computer (PC), a laptop PC, a desktop PC, and the like.

The electronic apparatus 100 may set a plurality of photographingparameters for analyzing the user's skin. In detail, the electronicapparatus 100 may photograph a user's face a plurality of times on thebasis of a plurality of preliminary photographing parameters, andanalyze brightness of a plurality of images photographed on the basis ofthe plurality of preliminary photographing parameters to set preliminaryphotographing parameters corresponding to a plurality of user's faceregions among the plurality of preliminary photographing parameters tothe plurality of photographing parameters. In addition, the electronicapparatus 100 may store the plurality of photographing parameters thatare set.

In addition, the electronic apparatus 100 may photograph the user's facea plurality of times on the basis of the plurality of photographingparameters to obtain a plurality of images.

In addition, the electronic apparatus 100 may extract user's faceregions corresponding to each of the plurality of images photographed onthe basis of the plurality of photographing parameters, and synthesizethe extracted user's face regions with each other.

In addition, the electronic apparatus 100 may transmit data on asynthesized image to the user terminal 200 for the purpose of skinanalysis for the user's face.

The user terminal 200 may decide a skin state of the user's face on thebasis of the data of the synthesized image. In addition, the userterminal 200 may analyze whether or not skin troubles (for example, awrinkle, a pimple, a pore, skin cancer, and the like) exist on theuser's face through image analysis.

The user terminal 200 may provide information on the skin state of theuser's face.

A case in which the electronic apparatus 100 transmits the data on thesynthesized image to the user terminal 200 is described in theabovementioned embodiment, but this is only an example, and theelectronic apparatus 100 may analyze the data on the synthesized imageto decide the skin state of the user's face and output information onthe decided skin state.

FIG. 2 is a block diagram schematically illustrating components of anelectronic apparatus 100 according to an embodiment of the presentdisclosure.

Referring FIG. 2, the electronic apparatus 100 includes a camera 110, acommunicator 120, and a processor 130.

The camera 110 photographs the user's face. In detail, the camera 110may photograph the user's face on the basis of the plurality ofphotographing parameters to obtain a plurality of images.

The communicator 120 performs communication with an external apparatus.Particularly, the communicator 120 may transmit a synthesized imageobtained by extracting a plurality of regions from the plurality ofimages photographed on the basis of the plurality of photographingparameters and synthesizing the extracted regions with each other to theuser terminal 200. The communicator can include a transceiver or similarelement to provide such wired or wireless transmission.

At least one processor 130 controls a general operation of theelectronic apparatus 100. Particularly, the processor 130 may photographthe user's face a plurality of times on the basis of the plurality ofphotographing parameters to obtain the plurality of images, extract theuser's face regions corresponding to each of the plurality of imagesphotographed on the basis of the plurality of photographing parameters,synthesize the extracted user's face regions with each other to createthe synthesized image, and control the communicator 120 to transmit thedata on the synthesized image to the user terminal 200 for the purposeof skin analysis for the user's face.

First, the processor 130 sets the photographing parameters for analyzingthe skin of the user's face. In detail, the processor 130 may photographthe user's face a plurality of times on the basis of the plurality ofpreliminary photographing parameters. Here, the plurality of preliminaryphotographing parameters may be determined depending on an externalillumination environment. In addition, the processor 130 may analyze thebrightness of the plurality of images photographed on the basis of theplurality of preliminary photographing parameters to set the preliminaryphotographing parameters corresponding to the plurality of user's faceregions among the plurality of preliminary photographing parameters tothe plurality of photographing parameters.

As an embodiment of the present disclosure, in the case in which animage photographed on the basis of a first preliminary photographingparameter of the plurality of preliminary photographing parameters has abrightness value in a predetermined range with respect to a first regionof the user's face (for example, a central region of the user's face),the processor 130 may set the first preliminary photographing parameterto a first photographing parameter corresponding to the first region ofthe user's face. In the case in which an image photographed on the basisof a second preliminary photographing parameter of the plurality ofpreliminary photographing parameters has a brightness value in apredetermined range with respect to a second region of the user's face(for example, an outer region of the user's face), the processor 130 mayset the second preliminary photographing parameter to a secondphotographing parameter corresponding to the second region of the user'sface.

Here, the photographing parameters may include at least one of anintensity of the light source included in the electronic apparatus 100,a direction of the light source, a shutter speed, and an F No, and maybe set to be different from each other for each of different users.

After the plurality of photographing parameters are set, the processor130 may photograph the user's face a plurality of times on the basis ofthe plurality of photographing parameters that are set to obtain theplurality of images. As an embodiment of the present disclosure, theprocessor 130 may photograph the user's face on the basis of the firstphotographing parameter to obtain a first image, and photograph theuser's face on the basis of the second photographing parameter to obtaina second image.

In addition, the processor 130 may extract the user's face regionscorresponding to each of the plurality of images from the plurality ofimages and synthesize the extracted user's face regions with each otherto obtain the synthesized image. As an embodiment of the presentdisclosure, the processor 130 may extract the first region of the user'sface from the first image photographed on the basis of the firstphotographing parameter, and extract the second region of the user'sface from the second image photographed on the basis of the secondphotographing parameter. In addition, the processor 130 may synthesizethe extracted first and second regions with each other to obtain asynthesized image.

In this case, the processor 130 may also correct the first and secondregions depending on sensed motion information of the electronicapparatus, and then synthesize the corrected first and second regionswith each other. That is, in the case in which motion of the electronicapparatus 100 or the user is sensed during a period in which the secondimage is photographed, the processor 130 may correct the second regiondepending on the sensed motion of the electronic apparatus or user.According to another embodiment, the processor 130 may correct thesecond image before extracting the second region, depending on themotion of the electronic apparatus 100.

In addition, when the processor 130 synthesizes the first and secondregions with each other, the processor 130 may perform brightnesscorrection and then synthesize the extracted first and second regionswith each other. In detail, the processor 130 may decide a brightnessvalue difference between the first region and the second region in thevicinity of a boundary between the first region and the second region.In addition, the processor 130 may decide a synthesis weight for atleast one of the first region and the second region on the basis of thebrightness value difference. Here, the synthesis weight may be a weightfor adjusting brightness. In addition, the processor 130 may adjustbrightness of at least one of the first region and the second region onthe basis of the synthesis weight, and then synthesize the first regionand the second region with each other.

In addition, the processor 130 may control the communicator 120 totransmit the synthesized image to the user terminal 200.

A case in which the electronic apparatus 100 transmits the synthesizedimage to the user terminal 200 is described in the abovementionedembodiment, but this is only an example, and the electronic apparatus100 may transmit the plurality of images obtained on the basis of theplurality of photographing parameters to the user terminal 200. In thiscase, the user terminal 200 may synthesize the plurality of images witheach other by the method or methods as described above to analyze theskin state of the user's face.

According to another embodiment of the present disclosure, the processor130 may directly analyze the synthesized image to obtain skin stateinformation on at least one of pigmentation, a pimple, sebum, a pore,and a wrinkle existing on the user's face and output the obtained skinstate information.

FIG. 3 is a block diagram illustrating components of an electronicapparatus according to an embodiment of the present disclosure indetail.

Referring to FIG. 3, the electronic apparatus 100 may include the camera110, the communicator 120, a light source 140, an output 150, a memory160, an input 170, a sensor 180, and the processor 130. Since thecomponents of the electronic apparatus 100 illustrated in FIG. 3 areonly an example, they are not necessarily limited to those of the blockdiagram illustrated in FIG. 3. Therefore, some of the components of theelectronic apparatus 100 illustrated in FIG. 3 may be omitted, modified,or added depending on a kind of electronic apparatus 100 or a purpose ofthe electronic apparatus 100.

The camera 110 may be positioned on an upper end of a front surface ofthe electronic apparatus 100, surrounded by communicator features 120-1,120-2 and 120-3, as illustrated in FIG. 1, and may photograph the user'sface. In this case, the camera 110 may photograph the user's face aplurality of times on the basis of different photographing parameters(for example, a shutter speed value, an F No, and the like) to obtainthe plurality of images.

The light source 140 provides light toward the user's face.Particularly, a plurality of light sources 140 may be provided in thevicinity of the camera 110. In addition, the light source 140 mayprovide light having different intensities, shades (wavelengths) and soforth, depending on a control of the processor 130 during a period inwhich the user's face is photographed.

The output 150 outputs various information. Particularly, the output 150may include a display 151 and an audio output 153, as illustrated inFIG. 3.

The display 151 displays various image data and user interfaces (UIs).The display 151 may also provide information on the skin state of theuser's face.

According to an embodiment of the present disclosure, in the case inwhich the electronic apparatus 100 is implemented by a portable terminalsuch as a smartphone, the display 151 may be coupled to a touch panel tobe implemented as a touch screen, and may have a form of a flexibledisplay to be coupled to at least one of a front surface region, a sidesurface region, and a rear surface region of the electronic apparatus100. The flexible display may be bent, curved, or rolled without beingdamaged through the use of a thin and flexible substrate like paper.

The audio output 153 is a component outputting various alarms or audiomessages as well as various audio data on which various processes suchas decoding, amplification, noise filtering, and the like, are performedby an audio processor (not illustrated). According to another embodimentof the present disclosure, the electronic apparatus 100 may furtherinclude an output terminal as a component for outputting an audio.

Particularly, the audio output 153 may provide information on the skinstate of the user's face in an audio form.

The communicator 120 may perform communication with the user terminal200. Particularly, the communicator 120 may receive a request for thephotographing of the user's face from the user terminal 200, andtransmit the synthesized image to the user terminal 200. In this case,the communicator 120 may be implemented by a Bluetooth module, but thisis only an example, and the communicator 120 may be implemented byvarious communication modules such as a Zigbee communication module, awireless fidelity (WiFi) communication module, a near fieldcommunication (NFC) communication module, and the like.

The memory 160 stores various modules for driving the electronicapparatus 100 therein. For example, software including a base module, asensing module, a communication module, a presentation module, a webbrowser module, and a service module may be stored in the memory 160.Here, the base module is a basic module processing signals transferredfrom hardware included in the electronic apparatus 100 and transferringthe processed signals to an upper layer module. The sensing module,which is a module collecting information from various sensors andanalyzing and managing the collected information, may include a facerecognizing module, an audio recognizing module, a motion recognizingmodule, and the like. The presentation module, which is a module forconfiguring a display screen, may include a multimedia module forreproducing and outputting a multimedia content and a user interface(UI) rendering module performing UI and graphic processing. Thecommunication module is a module for performing communication with theoutside. The web browser module is a module performing web browsing toaccess a web server. The service module is a module including variousapplications for providing various services.

As described above, the memory 160 may include various program modules.However, some of the various program modules may be omitted, modified,or added depending on a kind and a property of electronic apparatus 100.

In addition, the memory 160 may store a plurality of photographingparameters for each user therein.

The memory 160 may be implemented by a non-volatile memory, a volatilememory, a flash memory, a hard disk drive (HDD), a solid state drive(SDD), or the like. The memory 160 is accessed by the processor 130, andreadout, recording, correction, deletion, update, and the like, of datain the memory 160 may be performed by the processor 130. In the presentdisclosure, the term ‘memory’ includes the memory 160, a read onlymemory (ROM) (not illustrated) in the processor 130, a random accessmemory (RAM) (not illustrated), or a memory card (not illustrated) (forexample, a micro secure digital (SD) card or a memory stick) mounted inthe electronic apparatus 100.

The input 170 may input a user command for manipulating the electronicapparatus 100, and transmit information on the user command to theprocessor 130. Particularly, the input 170 may be a button (for example,a button for performing photographing, or the like) included in theelectronic apparatus 100, but this is only an example, and the input 170may be implemented by any number of other input devices.

As an embodiment of the present disclosure, the input 170 may beimplemented by a touch panel for sensing a user touch, a (digital) pensensor, or the like. The touch panel may use at least one of, forexample, a capacitive manner, a resistive manner, an infrared manner, oran ultrasonic manner. In addition, the touch panel may further include acontrol circuit. However, a case in which the input 170 is implementedby the touch panel, the pen sensor, or the like, is only an example, andthe input 170 may be implemented by various electronic devices such as amicrophone for receiving user utterance, a pointing device, and thelike.

The sensor 180 includes various sensors for sensing a state of theelectronic apparatus 100. Particularly, the sensor 180 may include amotion sensor (for example, an acceleration sensor, a gyro sensor, aterrestrial magnetism sensor, an electromagnetic sensor, or the like)for sensing motion of the electronic apparatus 100, an illuminancesensor for sensing an illumination environment around the electronicapparatus 100, and the like.

The processor 130 may be electrically connected to various components(for example, the output 150, the memory 160, the camera 110, and thelike) of the electronic apparatus 100 to control a general operation andfunction of the electronic apparatus 100. Particularly, the processor130 may control the general operation of the electronic apparatus 100using various programs stored in the memory 160.

In detail, the processor 130 may photograph the user's face a pluralityof times on the basis of the plurality of photographing parameters toobtain the plurality of images, extract the user's face regionscorresponding to each of the plurality of images photographed on thebasis of the plurality of photographing parameters, synthesize theextracted user's face regions with each other to create the synthesizedimage, and control the communicator 120 to transmit the synthesizedimage to the user terminal 200 for the purpose of the skin analysis forthe user's face.

An embodiment in which the processor 130 interworks with the userterminal 200 to provide the information on the skin state of the user'sface will be described in detail with reference to FIGS. 4A to 6E.

FIGS. 4A and 4B are views for describing examples of analyzing a user'sskin using a skin analyzing application according to an embodiment ofthe present disclosure.

Referring to FIG. 4A, the user terminal 200 may execute a skin analyzingapplication in response to a user command, and display a start screen ofthe skin analyzing application, as illustrated in FIG. 4A. In this case,a UI for user login may be included in the start screen of the skinanalyzing application.

Referring to FIG. 4B, when the user login is performed, the userterminal 200 may search the electronic apparatus 100 with which it maycommunicate. In this case, the user terminal 200 may display a screenguiding the search of the electronic apparatus 100, as illustrated inFIG. 4B.

In the case in which the electronic apparatus 100 is searched, the userterminal 200 may perform the communication with the electronic apparatus100. In this case, the user terminal 200 may perform the communicationwith the electronic apparatus 100 using Bluetooth communication. In thecase in which the communication between the user terminal 200 and theelectronic apparatus 100 is connected, the user terminal 200 maytransmit information on a logged-in user to the electronic apparatus100.

The processor 130 of the electronic apparatus 100 decides whether or nota plurality of photographing parameters for the logged-in user arepredetermined.

In the case in which the plurality of photographing parameterscorresponding to the logged-in user are not set, the processor 130 mayset a plurality of photographing parameters corresponding to the user'sface regions among a plurality of preliminary photographing parameters.

In detail, the processor 130 may photograph a user's face on the basisof the plurality of preliminary photographing parameters through thecamera 110 to obtain a plurality of images. For example, the processor130 may photograph the user's face on the basis of first to n-thpreliminary photographing parameters to obtain first to n-th images.Here, the preliminary photographing parameters may include an intensityof the light source 140, a direction of the light source 140, a shutterspeed of the camera 110, an F No, an exposure value, and the like, andmay be determined depending on external illumination sensed by thesensor 180.

A case in which the plurality of images are obtained by photographingthe user's face on the basis of the plurality of preliminaryphotographing parameters is described in the abovementioned embodiment,but this is only an example, and a moving picture may be obtained byphotographing the user's face while changing the preliminaryphotographing parameters in real time.

In addition, the processor 130 may analyze the brightness of theplurality of images photographed on the basis of the plurality ofpreliminary photographing parameters to set the preliminaryphotographing parameters corresponding to the plurality of user's faceregions among the plurality of preliminary photographing parameters tothe plurality of photographing parameters.

As an embodiment of the present disclosure, in the case in which theimage photographed on the basis of the first preliminary photographingparameter of the plurality of preliminary photographing parameters hasthe brightness value in the predetermined range with respect to thecentral region of the user's face, the processor 130 may set the firstpreliminary photographing parameter to the first photographing parametercorresponding to the central region of the user's face. In addition, inthe case in which the image photographed on the basis of the secondpreliminary photographing parameter of the plurality of preliminaryphotographing parameters has the brightness value in the predeterminedrange with respect to the outer region of the user's face, the processor130 may set the second preliminary photographing parameter to the secondphotographing parameter corresponding to the outer region of the user'sface. That is, the processor 130 may set preliminary photographingparameter having optimal brightness values in the central region and theouter region of the user's face to photographing parameterscorresponding to the respective regions.

In this case, an intensity of the light source included in thephotographing parameter corresponding to the central region of theuser's face may be weaker than that of the light source included in thephotographing parameter corresponding to the outer region of the user'sface. In addition, a shutter speed included in the photographingparameter corresponding to the central region of the user's face may begreater than that included in the photographing parameter correspondingto the outer region of the user's face. In addition, an F No (openingvalue) included in the photographing parameter corresponding to thecentral region of the user's face may be smaller than that included inthe photographing parameter corresponding to the outer region of theuser's face. In addition, an exposure value included in thephotographing parameter corresponding to the central region of theuser's face may be smaller than that included in the photographingparameter corresponding to the outer region of the user's face.

The user's face is divided into two regions (for example, the centralregion and the outer region) in the abovementioned embodiment, but thisis only an example, and the user's face may be divided into three ormore regions and photographing parameters corresponding to therespective regions may be set.

In addition, the processor 130 may photograph the user's face on thebasis of the plurality of photographing parameters that are set, throughthe camera 110 to obtain the plurality of images. For example, theprocessor 130 may obtain the first image photographed using the firstphotographing parameter and the second image photographed using thesecond photographing parameter.

FIGS. 5A, 5B and 5C are views for describing examples of analyzing auser's skin using a skin analyzing application according to anembodiment of the present disclosure.

Referring to FIG. 5A, the first image may include a central region 510-1having a brightness value in a first range and an outer region 520-1having a brightness value in a second range, as illustrated in FIG. 5A.

Referring to FIG. 5B, the second image may include a central region510-2 having a brightness value in a third range and an outer region520-2 having a brightness value in a fourth range, as illustrated inFIG. 5B. Here, the first range and the fourth range may have anoverlapping section existing therebetween. That is, the first range andthe fourth range may have the same or similar brightness value.

In addition, the processor 130 may extract the user's face regionscorresponding to each of the plurality of images from the plurality ofimages, and synthesize the extracted user's face regions with each otherto create the synthesized image.

Referring to FIG. 5C, the processor 130 may extract the central region510-1 corresponding to the first image from the first image, extract theouter region 520-2 corresponding to the second image from the secondimage, and synthesize the central region 510-1 corresponding to thefirst image and the outer region 520-2 corresponding to the second imagewith each other to create a synthesized image 530 for the user's face,as illustrated in FIG. 5C. In this case, an entire face region of thesynthesized image 530 may have an entirely uniform brightness value, asillustrated in FIG. 5C.

In this case, the processor 130 may correct the first and second regionsdepending on the motion information of the electronic apparatus 100 orthe user sensed through the sensor 180, and then synthesize thecorrected first and second regions with each other.

In detail, in the case in which the user photographs his/her face usingthe electronic apparatus 100, the electronic apparatus 100 may be shakenfor example. Therefore, when the processor 130 synthesizes the firstregion extracted from the first image and the second region extractedfrom the second image with each other, the processor 130 may move andcorrect at least one of the first and second regions depending on themotion information of the electronic apparatus 100 sensed through thesensor 180, and then synthesize the moved and corrected first and secondregions with each other. In this case, the processor 130 may correct thefirst region and the second region, but this is only an example, and theprocessor 130 may correct at least one of the first image and the secondimage before extracting the first region and the second region.

In addition, the processor 130 may decide the brightness valuedifference between the first region and the second region in thevicinity of the boundary between the first region and the second region,decide the synthesis weight for at least one of the first region and thesecond region on the basis of the brightness value difference, andadjust brightness of at least one of the first region and the secondregion on the basis of the synthesis weight, and then synthesize thefirst region and the second region with each other. For example, in thecase in which a brightness value of the first region is greater thanthat of the second region by “a” in the vicinity of the boundary betweenthe first region and the second region, the processor 130 may increasethe brightness value as a synthesis weight for the second region by “a”,and then synthesize the first region and the second region with eachother.

As described above, a more accurate synthesized image for the user'sface may be obtained through motion correction and brightnesscorrection.

In addition, the processor 130 may control the communicator 120 totransmit the synthesized image for the user's face to the user terminal200.

FIGS. 6A, 6B, 6C, 6D and 6E are views for describing examples ofanalyzing a user's skin using a skin analyzing application according toan embodiment of the present disclosure.

In the case in which the synthesized image for the user's face isreceived, the user terminal 200 may display the synthesized image forthe user's face, as illustrated in FIG. 6A.

Referring to FIG. 6A, the user terminal 200 may analyze the skin statefor the user's face on the basis of the synthesized image.

As an embodiment of the present disclosure, the user terminal 200 mayseparate the synthesized image into a melanin image and a hemoglobinimage using pigment separation technology. In addition, the userterminal 200 may analyze the melanin image to obtain information onmacula and a skin tone. In addition, the user terminal 200 may analyzethe hemoglobin image to obtain information on erythema existing on theuser's face.

In addition, as another embodiment of the present disclosure, the userterminal 200 may analyze RGB of the synthesized image to obtaininformation on a pimple (for example, information on whether or not thepimple is generated, a probability that the pimple will be generated,and the like) existing on the user's face.

In addition, as another embodiment of the present disclosure, the userterminal 200 may obtain information on sebum existing on the user's facefrom an ultraviolet (UV) image of the synthesized image.

In addition, as another embodiment of the present disclosure, the userterminal 200 may analyze RGB of the synthesized image to obtaininformation on a pore (for example, information on whether or not thepore exists, a depth of the pore, and the like) existing on the user'sface.

In addition, as another embodiment of the present disclosure, the userterminal 200 may analyze RGB of the synthesized image to obtaininformation on a wrinkle (for example, information on whether or not thewrinkle exists, a depth of the wrinkle, and the like) existing on theuser's face.

In addition, as another embodiment of the present disclosure, the userterminal 200 may analyze RGB of the synthesized image to obtaininformation on a scar (for example, information on whether or not thescar exists, a depth of the scar, and the like) existing on the user'sface.

Referring to FIG. 6B, the user terminal 200 may output the obtainedinformation on the skin state of the user's face. For example, the userterminal 200 may display a UI visually providing the information on theskin state, as illustrated in FIG. 6B.

Referring to FIG. 6C, the user terminal 200 may display a UI includinghistory information on the analyzed skin state, as illustrated in FIG.6C.

Referring to FIG. 6D, the user terminal 200 may display a UI providingskin trouble prevention information and information on recommendedcosmetics, as illustrated in FIG. 6D.

Referring to FIG. 6E, the user terminal 200 may provide a chattingservice with a skin counselor, as illustrated in FIG. 6E.

According to the various embodiments of the present disclosure asdescribed above, a face image having a uniform brightness distributionover an entire region of the user' face may be obtained to increaseaccuracy of a face skin analyzing result. In addition, since the user'sface does not need to be inserted into the electronic apparatus, theelectronic apparatus may be manufactured having a small size and a lightweight, such that convenience in carrying the electronic apparatus maybe improved.

A case in which the electronic apparatus 100 creates the synthesizedimage and transmits the synthesized image to the user terminal 200 andthe user terminal 200 analyzes the synthesized image to obtain theinformation on the skin state of the user's face is described in theabovementioned embodiment, but this is only an example, and theelectronic apparatus 100 may directly analyze the synthesized image toobtain the information on the skin state of the user's face.

FIG. 7 is a sequence diagram for describing a control method of a systemfor analyzing the skin of a user's face according to an embodiment ofthe present disclosure.

Referring to FIG. 7, the electronic apparatus 100 sets the plurality ofphotographing parameters at S710. In this case, the electronic apparatus100 may set the preliminary photographing parameters by which imageshaving optimal brightness values may be obtained with respect to therespective regions of the user's face among the plurality of preliminaryphotographing parameters to the plurality of photographing parameters.

In addition, the electronic apparatus 100 and the user terminal 200perform communication with each other at S720. In another embodiment ofthe present disclosure, S710 may be performed after S720.

The electronic apparatus 100 obtains the plurality of images using theplurality of photographing parameters at S730. In detail, the electronicapparatus 100 may photograph the user's face on the basis of theplurality of photographing parameters to obtain the plurality of images.

The electronic apparatus 100 creates the synthesized image at S740. Indetail, the electronic apparatus 100 may extract the user's face regionscorresponding to each of the plurality of images obtained by theplurality of photographing parameters, and synthesize the extracteduser's face regions with each other to create the synthesized image.

The electronic apparatus 100 transmits the synthesized image to the userterminal 200 at S750.

The user terminal 200 analyzes the synthesized image at S760.Particularly, the user terminal 200 may analyze the synthesized image toobtain the information (for example, a pimple, a color tone, a wrinkle,and the like) on the skin state of the user's face.

The user terminal 200 provides the information on the skin state of theuser's face at S770.

A case in which the electronic apparatus 100 synthesizes the pluralityof images photographed on the basis of the plurality of photographingparameters with each other to be one image is described in theabovementioned embodiment, but this is only an example, and theelectronic apparatus 100 may obtain the plurality of images, transmitthe plurality of images to the user terminal 200, and the user terminal200 may synthesize the plurality of images with each other to be oneimage.

FIG. 8 is a flowchart for describing a method in which an electronicapparatus obtains information on a skin state of a user's face bytransmitting a synthesized image to a user terminal, according to anembodiment of the present disclosure.

Referring to FIG. 8, the electronic apparatus 100 photographs the user'sface a plurality of times on the basis of the plurality of photographingparameters to obtain the plurality of images at S810. Here, theplurality of photographing parameters may be predetermined. For example,the electronic apparatus 100 may obtain the first image using the firstphotographing parameter, and obtain the second image using the secondphotographing parameter.

In addition, the electronic apparatus 100 extracts the user's faceregions corresponding to each of the plurality of images photographed onthe basis of the plurality of photographing parameters at S820. Forexample, the electronic apparatus 100 may extract the central region ofthe user's face from the first image, and extract the outer region ofthe user's face from the second image.

In addition, the electronic apparatus 100 synthesizes the extracteduser's face regions with each other at S830. For example, the electronicapparatus 100 may synthesize the central region extracted from the firstimage and the outer region extracted from the second image with eachother to obtain the synthesized image for the user's face.

The electronic apparatus 100 transmits the data on the synthesized imageto the user terminal 200 at S840.

FIG. 9 is a flowchart for describing a method in which an electronicapparatus directly obtains information on a skin state of a user's face,according to an embodiment of the present disclosure.

Referring to FIG. 9, S910 to S930 illustrated in FIG. 9 are the same asS810 to S830 described above with reference to FIG. 8, and anoverlapping description will thus be omitted.

In addition, the electronic apparatus 100 analyzes the synthesized imageto decide the skin state of the user's face at S940. In detail, theelectronic apparatus 100 may analyze the synthesized image to obtainvarious information on the skin state such as a skin tone, as well asskin troubles (for example, a pimple, a pore, a wrinkle, and the like)of the user's face.

The electronic apparatus 100 provides the information on the decidedskin state at S950. In this case, the electronic apparatus 100 mayvisually provide the information on the skin state and the servicethrough the various UIs as illustrated in FIGS. 6A to 6E, but this isonly an example, and the electronic apparatus 100 may provide theinformation on the skin state in an auditory form.

The methods described above may be implemented in a form of programcommands that may be executed through various computer means and may berecorded in a computer-readable recording medium. The computer-readablerecording medium may include a program command, a data file, a datastructure or the like, alone or a combination thereof. The programcommands recorded in the computer-readable recording medium may beespecially designed and configured for the present disclosure or beknown to those skilled in a field of computer software. Examples of thecomputer-readable recording medium may include a magnetic medium such asa hard disk, a floppy disk, and a magnetic tape; an optical medium suchas a compact disk read only memory (CD-ROM) or a digital versatile disk(DVD); a magneto-optical medium such as a floptical disk; and a hardwaredevice specially configured to store and execute program commands, suchas a ROM, a random access memory (RAM), a flash memory, or the like.Examples of the program commands include a high-level language codecapable of being executed by a computer using an interpreter, or thelike, as well as a machine language code made by a compiler. Theabovementioned hardware device may be constituted to be operated as oneor more software modules to perform an operation according to thepresent disclosure, and vice versa.

While the present disclosure has been shown and described with referenceto various embodiments thereof, it will be understood by those skilledin the art that various changes in form and details may be made thereinwithout departing from the spirit and scope of the present disclosure asdefined by the appended claims and their equivalents.

What is claimed is:
 1. An electronic apparatus comprising: a cameraconfigured to photograph a user's face; a transceiver configured toperform communication with a user terminal; and at least one processorconfigured to: control the camera to photograph the user's face aplurality of times based on a plurality of photographing parameters toobtain a plurality of images, extract face regions corresponding to eachof the plurality of images photographed based on the plurality ofphotographing parameters, synthesize the extracted face regions witheach other to create a synthesized image, and control the transceiver totransmit data on the synthesized image to the user terminal for skinanalysis of the user's face, wherein the at least one processor isfurther configured to: extract a first region of the user's face,corresponding to a predetermined range of a brightness value, from afirst image photographed based on a first photographing parameter,extract a second region of the user's face, corresponding to apredetermined range of a brightness value, from a second imagephotographed based on a second photographing parameter, and synthesizethe first region extracted from the first image and the second regionextracted from the second image with each other.
 2. The electronicapparatus of claim 1, wherein the at least one processor is furtherconfigured to: control the camera to photograph the user's face aplurality of times based on a plurality of preliminary photographingparameters, and analyze a brightness of a plurality of imagesphotographed based on the plurality of preliminary photographingparameters to set preliminary photographing parameters corresponding toa plurality of face regions among the plurality of preliminaryphotographing parameters to the plurality of photographing parameters.3. The electronic apparatus of claim 2, wherein the at least oneprocessor is further configured to: set a first preliminaryphotographing parameter to the first photographing parametercorresponding to the first region of the user's face in a case in whichan image photographed based on the first preliminary photographingparameter of the plurality of preliminary photographing parameters hasthe brightness value in the predetermined range with respect to thefirst region of the user's face, and set a second preliminaryphotographing parameter to the second photographing parametercorresponding to the second region of the user's face in a case in whichan image photographed based on the second preliminary photographingparameter of the plurality of preliminary photographing parameters hasthe brightness value in the predetermined range with respect to thesecond region of the user's face.
 4. The electronic apparatus of claim1, wherein the at least one processor is further configured to: correctthe first and second regions depending on sensed motion information ofthe electronic apparatus, and synthesize the corrected first and secondregions with each other.
 5. The electronic apparatus of claim 1, whereinthe at least one processor is further configured to: decide a brightnessvalue difference between the first region and the second region in avicinity of a boundary between the first region and the second region,decide a synthesis weight for at least one of the first region and thesecond region based on the brightness value difference, adjust abrightness of at least one of the first region and the second regionbased on the synthesis weight, and synthesize the first region and thesecond region with each other.
 6. The electronic apparatus of claim 2,wherein the plurality of preliminary photographing parameters aredetermined depending on an external illumination environment.
 7. Theelectronic apparatus of claim 1, wherein the first photographingparameter is at least one of an intensity of a light source included inthe electronic apparatus, a shutter speed, or an opening value.
 8. Theelectronic apparatus of claim 1, further comprising a display, whereinthe at least one processor is further configured to: analyze thesynthesized image to obtain skin state information on at least one of apigmentation, a pimple, sebum, a pore, or a wrinkle existing on theuser's face, and control the display to output the obtained skin stateinformation.
 9. A control method of an electronic apparatus, the methodcomprising: photographing a user's face a plurality of times based on aplurality of photographing parameters to obtain a plurality of images;extracting face regions corresponding to each of the plurality of imagesphotographed based on the plurality of photographing parameters;synthesizing the extracted face regions with each other to create asynthesized image; and transmitting data on the synthesized image to auser terminal for skin analysis of the user's face, wherein thesynthesizing comprises: extracting a first region of the user's face,corresponding to a predetermined range of a brightness value, from afirst image photographed based on a first photographing parameter;extracting a second region of the user's face, corresponding to apredetermined range of a brightness value, from a second imagephotographed based on a second photographing parameter; and synthesizingthe first region extracted from the first image and the second regionextracted from the second image with each other.
 10. The control methodof claim 9, further comprising: photographing the user's face aplurality of times based on a plurality of preliminary photographingparameters; and analyzing a brightness of a plurality of imagesphotographed based on the plurality of preliminary photographingparameters to set preliminary photographing parameters corresponding toa plurality of face regions among the plurality of preliminaryphotographing parameters to the plurality of photographing parameters.11. The control method of claim 10, wherein a first preliminaryphotographing parameter is set to the first photographing parametercorresponding to the first region of the user's face in a case in whichan image photographed based on the first preliminary photographingparameter of the plurality of preliminary photographing parameters hasthe brightness value in the predetermined range with respect to thefirst region of the user's face, and wherein a second preliminaryphotographing parameter is set to the second photographing parametercorresponding to the second region of the user's face in a case in whichan image photographed based on the second preliminary photographingparameter of the plurality of preliminary photographing parameters hasthe brightness value in the predetermined range with respect to thesecond region of the user's face.
 12. The control method as claimed inclaim 9, wherein the synthesizing further comprises: correcting thefirst and second regions depending on sensed motion information of theelectronic apparatus; and synthesizing the corrected first and secondregions with each other.
 13. The control method as claimed in claim 9,wherein the synthesizing further comprises: deciding a brightness valuedifference between the first region and the second region in a vicinityof a boundary between the first region and the second region; deciding asynthesis weight for at least one of the first region and the secondregion based on the brightness value difference; adjusting a brightnessof at least one of the first region and the second region based on thesynthesis weight; and synthesizing the first region and the secondregion with each other.
 14. The control method of claim 10, wherein theplurality of preliminary photographing parameters are determineddepending on an external illumination environment.
 15. The controlmethod of claim 9, wherein the first photographing parameter is at leastone of an intensity of a light source included in the electronicapparatus, a shutter speed, or an opening value.
 16. The control methodof claim 9, further comprising: analyzing the synthesized image toobtain skin state information on at least one of a pigmentation, apimple, sebum, a pore, or a wrinkle existing on the user's face; andoutputting the obtained skin state information.
 17. A non-transitorycomputer-readable recording medium in which a program for executing acontrol method of an electronic apparatus is stored, wherein the controlmethod includes: photographing a user's face a plurality of times basedon a plurality of photographing parameters to obtain a plurality ofimages; extracting face regions corresponding to each of the pluralityof images photographed based on the plurality of photographingparameters and synthesizing the extracted face regions with each otherto create a synthesized image; analyzing the synthesized image to decidea skin state of the user's face; and providing information on the skinstate, wherein the synthesizing comprises: extracting a first region ofthe user's face, corresponding to a predetermined range of a brightnessvalue, from a first image photographed based on a first photographingparameter; extracting a second region of the user's face, correspondingto a predetermined range of a brightness value, from a second imagephotographed based on a second photographing parameter; and synthesizingthe first region extracted from the first image and the second regionextracted from the second image with each other.